Overview of the INEX 2010 Question Answering Track (QA@INEX)

نویسندگان

  • Eric SanJuan
  • Patrice Bellot
  • Véronique Moriceau
  • Xavier Tannier
چکیده

The INEX QA track (QA@INEX) aims to evaluate a complex question-answering task. In such a task, the set of questions is composed of complex questions that can be answered by several sentences or by an aggregation of texts from di erent documents. Question-answering, XML/passage retrieval and automatic summarization are combined in order to get closer to real information needs. Based on the groundwork carried out in 2009-2010 edition to determine the sub-tasks and a novel evaluation methodology, the 2011 edition of the track is contextualizing tweets using a recent cleaned dump of the Wikipedia.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Flesch and Dale-Chall Readability Measures for INEX 2011 Question-Answering Track

For INEX 2011 QA track, we wanted to measure the impact of two generic measures of readability in the selection of sentences related to topics. This is a step towards adaptive information retrieval approaches that take into account the reading skills of users and their level of expertise. We show that Flesch and Dale-Chall measures do not allow to filter sentences for obtaining a satisfactory r...

متن کامل

IRIT at INEX: Question Answering Task

In this paper we describe an approach to tweet contextualization developed in the context of INEX QA track. The task is to provide a context up to 500 words to a tweet. The summary should be an extract from the Wikipedia. Our approach is based on the index which includes not only lemmas, but also named entities. Sentence retrieval is based on standard TF-IDF measure enriched by named entity rec...

متن کامل

Passage Retrieval for Question Answering using Sliding Windows

The information retrieval (IR) community has investigated many different techniques to retrieve passages from large collections of documents for question answering (QA). In this paper, we specifically examine and quantitatively compare the impact of passage retrieval for QA using sliding windows and disjoint windows. We consider two different data sets, the TREC 2002–2003 QA data set, and 93 wh...

متن کامل

Overview of the INEX 2010 Ad Hoc Track

This paper gives an overview of the INEX 2010 Ad Hoc Track. The main goals of the Ad Hoc Track were three-fold. The first goal was to study focused retrieval under resource restricted conditions such as a small screen mobile device or a document summary on a hitlist. This leads to variants of the focused retrieval tasks that address the impact of result length/reading effort, thinking of focuse...

متن کامل

Overview of the INEX 2010 Data Centric Track

The INEX 2010 Data Centric Track is discussed. A dump of IMDb was used as the document collection, 28 topics were submitted, 36 runs were submitted by 8 institutes, and 26 topics were assessed. Most runs (all except 2) did not use the structure present in the topics; and consequently no improvement is yet seen by search engines that do so.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2010